Improving Quality of ICD-10 (International Statistical Classification of Diseases, Tenth Revision) Coding Using AI: Protocol for a Crossover Randomized Controlled Trial.

BACKGROUND: Computer-assisted clinical coding (CAC) tools are designed to help clinical coders assign standardized codes, such as the ICD-10 (International Statistical Classification of Diseases, Tenth Revision), to clinical texts, such as discharge summaries. Maintaining the integrity of these standardized codes is important both for the functioning of health systems and for ensuring data used for secondary purposes are of high quality. Clinical coding is an error-prone cumbersome task, and the complexity of modern classification systems such as the ICD-11 (International Classification of Diseases, Eleventh Revision) presents significant barriers to implementation. To date, there have only been a few user studies; therefore, our understanding is still limited regarding the role CAC systems can play in reducing the burden of coding and improving the overall quality of coding. OBJECTIVE: The objective of the user study is to generate both qualitative and quantitative data for measuring the usefulness of a CAC system, Easy-ICD, that was developed for recommending ICD-10 codes. Specifically, our goal is to assess whether our tool can reduce the burden on clinical coders and also improve coding quality. METHODS: The user study is based on a crossover randomized controlled trial study design, where we measure the performance of clinical coders when they use our CAC tool versus when they do not. Performance is measured by the time it takes them to assign codes to both simple and complex clinical texts as well as the coding quality, that is, the accuracy of code assignment. RESULTS: We expect the study to provide us with a measurement of the effectiveness of the CAC system compared to manual coding processes, both in terms of time use and coding quality. Positive outcomes from this study will imply that CAC tools hold the potential to reduce the burden on health care staff and will have major implications for the adoption of artificial intelligence-based CAC innovations to improve coding practice. Expected results to be published summer 2024. CONCLUSIONS: The planned user study promises a greater understanding of the impact CAC systems might have on clinical coding in real-life settings, especially with regard to coding time and quality. Further, the study may add new insights on how to meaningfully exploit current clinical text mining capabilities, with a view to reducing the burden on clinical coders, thus lowering the barriers and paving a more sustainable path to the adoption of modern coding systems, such as the new ICD-11. TRIAL REGISTRATION: clinicaltrials.gov NCT06286865; https://clinicaltrials.gov/study/NCT06286865. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/54593.

Using a Large Open Clinical Corpus for Improved ICD-10 Diagnosis Coding.

With the recent advances in natural language processing and deep learning, the development of tools that can assist medical coders in ICD-10 diagnosis coding and increase their efficiency in coding discharge summaries is significantly more viable than before. To that end, one important component in the development of these models is the datasets used to train them. In this study, such datasets are presented, and it is shown that one of them can be used to develop a BERT-based language model that can consistently perform well in assigning ICD-10 codes to discharge summaries written in Swedish. Most importantly, it can be used in a coding support setup where a tool can recommend potential codes to the coders. This reduces the range of potential codes to consider and, in turn, reduces the workload of the coder. Moreover, the de-identified and pseudonymised dataset is open to use for academic users.

Smartphone-based computer vision travelling aids for blind and visually impaired individuals: A systematic review.

Given the growth in the numbers of visually impaired (VI) people in low-income countries, the development of affordable electronic travel aid (ETA) systems employing devices, sensors, and apps embedded in ordinary smartphones becomes a potentially cost-effective and reasonable all-in-one solution of utmost importance for the VI. This paper offers an overview of recent ETA research prototypes that employ smartphones for assisted orientation and navigation in indoor and outdoor spaces by providing additional information about the surrounding objects. Scientific achievements in the field were systematically reviewed using PRISMA methodology. Comparative meta-analysis showed how various smartphone-based ETA prototypes could assist with better orientation, navigation, and wayfinding in indoor and outdoor environments. The analysis found limited interest among researchers in combining haptic interfaces and computer vision capabilities in smartphone-based ETAs for the blind, few attempts to employ novel state-of-the-art computer vision methods based on deep neural networks, and no evaluations of existing off-the-shelf navigation solutions. These results were contrasted with findings from a survey of blind expert users on their problems in navigating in indoor and outdoor environments. This revealed a major mismatch between user needs and academic development in the field.

Use of e-Health by Healthcare Professionals vs. non-Healthcare Professionals.

The role of e-health is increasing worldwide. We surveyed the use of e-health in a large-scale population-based study, involving a representative sample of the Norwegian population aged above 40 years. Two-thirds of the health professionals had used search engines, apps, social media or video services for health purposes - while this was the case for approximately half of the non-health professionals.

De-Identifying Swedish EHR Text Using Public Resources in the General Domain.

Sensitive data is normally required to develop rule-based or train machine learning-based models for de-identifying electronic health record (EHR) clinical notes; and this presents important problems for patient privacy. In this study, we add non-sensitive public datasets to EHR training data; (i) scientific medical text and (ii) Wikipedia word vectors. The data, all in Swedish, is used to train a deep learning model using recurrent neural networks. Tests on pseudonymized Swedish EHR clinical notes showed improved precision and recall from 55.62% and 80.02% with the base EHR embedding layer, to 85.01% and 87.15% when Wikipedia word vectors are added. These results suggest that non-sensitive text from the general domain can be used to train robust models for de-identifying Swedish clinical text; and this could be useful in cases where the data is both sensitive and in low-resource languages.

Privacy-preserving architecture for providing feedback to clinicians on their clinical performance.

BACKGROUND: Learning from routine healthcare data is important for the improvement of the quality of care. Providing feedback on clinicians' performance in comparison to their peers has been shown to be more efficient for quality improvements. However, the current methods for providing feedback do not fully address the privacy concerns of stakeholders. METHODS: The paper proposes a distributed architecture for providing feedback to clinicians on their clinical performances while protecting their privacy. The indicators for the clinical performance of a clinician are computed within a healthcare institution based on pseudonymized data extracted from the electronic health record (EHR) system. Group-level indicators of clinicians across healthcare institutions are computed using privacy-preserving distributed data-mining techniques. A clinician receives feedback reports that compare his or her personal indicators with the aggregated indicators of the individual's peers. Indicators aggregated across different geographical levels are the basis for monitoring changes in the quality of care. The architecture feasibility was practically evaluated in three general practitioner (GP) offices in Norway that consist of about 20,245 patients. The architecture was applied for providing feedback reports to 21 GPs on their antibiotic prescriptions for selected respiratory tract infections (RTIs). Each GP received one feedback report that covered antibiotic prescriptions between 2015 and 2018, stratified yearly. We assessed the privacy protection and computation time of the architecture. RESULTS: Our evaluation indicates that the proposed architecture is feasible for practical use and protects the privacy of the patients, clinicians, and healthcare institutions. The architecture also maintains the physical access control of healthcare institutions over the patient data. We sent a single feedback report to each of the 21 GPs. A total of 14,396 cases were diagnosed with the selected RTIs during the study period across the institutions. Of these cases, 2924 (20.3%) were treated with antibiotics, where 40.8% (1194) of the antibiotic prescriptions were narrow-spectrum antibiotics. CONCLUSIONS: It is feasible to provide feedback to clinicians on their clinical performance in comparison to peers across healthcare institutions while protecting privacy. The architecture also enables monitoring changes in the quality of care following interventions.

The Association Between Health Information Seeking on the Internet and Physician Visits (The Seventh Tromsø Study - Part 4): Population-Based Questionnaire Study.

BACKGROUND: The internet is being widely used for seeking health information. However, there is no consensus on the association between health information seeking on the internet and the use of health care services. OBJECTIVE: We examined the association between health information seeking via the internet and physician visits. In addition, we investigated the association between online health information seeking and the decisions to visit and not to visit a physician. METHODS: We used the cross-sectional electronic health (eHealth) data of 18,197 participants from the seventh survey of the Tromsø Study (Tromsø 7). The participants were aged ≥40 years and living in Tromsø, Norway. We used logistic regression models to examine the association between online health information seeking and physician visits, the decision to visit a physician, and the decision not to visit a physician, with adjustment for the demographic status, socioeconomic status, and health status of the participants. RESULTS: The use of Web search engines was associated with a physician visit. However, the association was moderated by age, and the OR decreased as age increased. The ORs for the use of Web search engines were 1.99 (95% CI 1.94-2.02) and 1.07 (95% CI 1.03-1.12) at ages 40 and 80 years, respectively. The decision to visit a physician was associated with the use of Web search engines (OR 2.95, 95% CI 2.03-4.46), video search engines (OR 1.43, 95% CI 1.21-1.70), and health apps (OR 1.26, 95% CI 1.13-1.42). The association between social media use and the decision to visit a physician was moderated by gender. Women who used social media had 1.42 (95% CI 1.31-1.55) times higher odds of deciding to visit a physician, whereas the decision to visit a physician was not different between men who used social media and those who did not use social media. Conversely, the decision not to visit a physician was associated with the use of Web search engines (OR 2.78, 95% CI 1.92-4.18), video search engines (OR 1.27, 95% CI 1.07-1.51), social media (OR 1.28, 95% CI 1.10-1.49), and health apps (OR 1.20, 95% CI 1.07-1.35). CONCLUSIONS: Health information found on the internet was positively associated with both the decision to visit a physician and the decision not to visit a physician. However, the association of health information seeking with the decision to visit a physician was slightly stronger than the association with the decision not to visit a physician. This could imply that the use of eHealth services is associated with a resultant increase in physician visits. In summary, our findings suggest that the internet serves as a supplement to health care services rather than as a replacement.

Impact of Illness on Electronic Health Use (The Seventh Tromsø Study - Part 2): Population-Based Questionnaire Study.

BACKGROUND: Patients who suffer from different diseases may use different electronic health (eHealth) resources. Thus, those who plan eHealth interventions should take into account which eHealth resources are used most frequently by patients that suffer from different diseases. OBJECTIVE: The aim of this study was to understand the associations between different groups of chronic diseases and the use of different eHealth resources. METHODS: Data from the seventh survey of the Tromsø Study (Tromsø 7) were analyzed to determine how different diseases influence the use of different eHealth resources. Specifically, the eHealth resources considered were use of apps, search engines, video services, and social media. The analysis contained data from 21,083 participants in the age group older than 40 years. A total of 15,585 (15,585/21,083; 73.92%) participants reported to have suffered some disease, 10,604 (10,604/21,083; 50.29%) participants reported to have used some kind of eHealth resource in the last year, and 7854 (7854/21,083; 37.25%) participants reported to have used some kind of eHealth resource in the last year and suffered (or had suffered) from some kind of specified disease. Logistic regression was used to determine which diseases significantly predicted the use of each eHealth resource. RESULTS: The use of apps was increased among those individuals that (had) suffered from psychological problems (odds ratio [OR] 1.39, 95% CI 1.23-1.56) and cardiovascular diseases (OR 1.12, 95% CI 1.01-1.24) and those part-time workers that (had) suffered from any of the diseases classified as others (OR 2.08, 95% CI 1.35-3.32). The use of search engines for accessing health information increased among individuals who suffered from psychological problems (OR 1.39, 95% CI 1.25-1.55), cancer (OR 1.26, 95% CI 1.11-1.44), or any of the diseases classified as other diseases (OR 1.27, 95% CI 1.13-1.42). Regarding video services, their use for accessing health information was more likely when the participant was a man (OR 1.31, 95% CI 1.13-1.53), (had) suffered from psychological problems (OR 1.70, 95% CI 1.43-2.01), or (had) suffered from other diseases (OR 1.43, 95% CI 1.20-1.71). The factors associated with an increase in the use of social media for accessing health information were as follows: (had) suffered from psychological problems (OR 1.65, 95% CI 1.42-1.91), working part time (OR 1.35, 95% CI 0.62-2.63), receiving disability benefits (OR 1.42, 95% CI 1.14-1.76), having received an upper secondary school education (OR 1.20, 95% CI 1.03-1.38), being a man with a high household income (OR 1.67, 95% CI 1.07-2.60), suffering from cardiovascular diseases and having a high household income (OR 3.39, 95% CI 1.62-8.16), and suffering from respiratory diseases while being retired (OR 1.95, 95% CI 1.28-2.97). CONCLUSIONS: Our findings show that different diseases are currently associated with the use of different eHealth resources. This knowledge is useful for those who plan eHealth interventions as they can take into account which type of eHealth resource may be used for gaining the attention of the different user groups.

Electronic Health Use in a Representative Sample of 18,497 Respondents in Norway (The Seventh Tromsø Study - Part 1): Population-Based Questionnaire Study.

BACKGROUND: Electronic health (eHealth) services may help people obtain information and manage their health, and they are gaining attention as technology improves, and as traditional health services are placed under increasing strain. We present findings from the first representative, large-scale, population-based study of eHealth use in Norway. OBJECTIVE: The objectives of this study were to examine the use of eHealth in a population above 40 years of age, the predictors of eHealth use, and the predictors of taking action following the use of these eHealth services. METHODS: Data were collected through a questionnaire given to participants in the seventh survey of the Tromsø Study (Tromsø 7). The study involved a representative sample of the Norwegian population aged above 40 years old. A subset of the more extensive questionnaire was explicitly related to eHealth use. Data were analyzed using logistic regression analyses. RESULTS: Approximately half (52.7%; 9752/18,497) of the respondents had used some form of eHealth services during the last year. About 58% (5624/9698) of the participants who had responded to a question about taking some type of action based on information gained from using eHealth services had done so. The variables of being a woman (OR 1.58; 95% CI 1.47-1.68), of younger age (40-49 year age group: OR 4.28, 95% CI 3.63-5.04), with a higher education (tertiary/long: OR 3.77, 95% CI 3.40-4.19), and a higher income (>1 million kr [US $100,000]: OR 2.19, 95% CI 1.77-2.70) all positively predicted the use of eHealth services. Not living with a spouse (OR 1.14, 95% CI 1.04-1.25), having seen a general practitioner (GP) in the last year (OR 1.66, 95% CI 1.53-1.80), and having had some disease (such as heart disease, cancer, asthma, etc; OR 1.29, 95% CI 1.18-1.41) also positively predicted eHealth use. Self-rated health status did not significantly influence eHealth use. Taking some action following eHealth use was predicted with the variables of being a woman (OR 1.16, 95% CI 1.07-1.27), being younger (40-49 year age group: OR 1.72, 95% CI 1.34-2.22), having a higher education (tertiary/long: OR 1.65, 95% CI 1.42-1.92), having seen a GP in the last year (OR 1.58, 95% CI 1.41-1.77), and having ever had a disease (such as heart disease, cancer or asthma; OR 1.26, 95% CI 1.14-1.39). CONCLUSIONS: eHealth appears to be an essential supplement to traditional health services for those aged above 40 years old, and especially so for the more resourceful. Being a woman, being younger, having higher education, having had a disease, and having seen a GP in the last year all positively predicted using the internet to get health information and taking some action based on this information.

Impact of the Use of Electronic Health Tools on the Psychological and Emotional Well-Being of Electronic Health Service Users (The Seventh Tromsø Study - Part 3): Population-Based Questionnaire Study.

BACKGROUND: Electronic health (eHealth) has been described as a silver bullet for addressing how challenges of the current health care system may be solved by technological solutions in future strategies and visions for modern health care. However, the evidence of its effects on service quality and cost effectiveness remains unclear. In addition, patients' psychological and emotional reactions to using eHealth tools are rarely addressed by the scientific literature. OBJECTIVE: This study aimed to assess how the psychological and emotional well-being of eHealth service users is affected by the use of eHealth tools. METHODS: We analyzed data from a population-based survey in Norway, conducted in the years 2015-2016 and representing 10,604 eHealth users aged over 40 years, to identify how the use of eHealth tools was associated with feeling anxious, confused, knowledgeable, or reassured. Associations between these four emotional outcomes and the use of four types of eHealth services (Web search engines, video search engines, health apps, and social media) were analyzed using logistic regression models. RESULTS: The use of eHealth tools made 72.41% (6740/9308) of the participants feel more knowledgeable and 47.49% (4421/9308) of the participants feel more reassured about their health status. However, 25.69% (2392/9308) reported feeling more anxious and 27.88% (2595/9308) reported feeling more confused using eHealth tools. A high level of education and not having a full-time job were associated with positive reactions and emotions (feeling more knowledgeable and reassured), whereas low self-reported health status and not having enough friends who could provide help and support predicted negative reactions and emotions (ie, feeling anxious and confused). Overall, the positive emotional effects of eHealth use (feeling knowledgeable and reassured) were relatively more prevalent among users aged over 40 years than the negative emotional effects (ie, feeling anxious and confused). About one-fourth of eHealth users reported being more confused and anxious after using eHealth services. CONCLUSIONS: The search for health information on the internet can be motivated by a range of factors and needs (not studied in this study), and people may experience a range of reactions and feelings following health information searching on the Web. Drawing on prior studies, we categorized reactions as positive and negative reactions. Some participants had negative reactions, which is challenging to resolve and should be taken into consideration by eHealth service providers when designing services (ie, including concrete information about how users can get more help and support). There is a need for more studies examining a greater range of reactions to online health information and factors that might predict negative reactions to health information on the Web.

Indoor Navigation Systems for Visually Impaired Persons: Mapping the Features of Existing Technologies to User Needs.

Currently, several outdoor navigation and orientation electronic traveling aid (ETA) solutions for visually impaired (VI) people are commercially available or in active development. This paper's survey of blind experts has shown that after outdoor navigation, the second most important ETA feature for VI persons is indoor navigation and orientation (in public institutions, supermarkets, office buildings, homes, etc.). VI persons need ETA for orientation and navigation in unfamiliar indoor environments with embedded features for the detection and recognition of obstacles (not only on the ground but also at head level) and desired destinations such as rooms, staircases, and elevators. The development of such indoor navigation systems, which do not have Global Positioning System (GPS) locational references, is challenging and requires an overview and evaluation of existing systems with different navigation technologies. This paper presents an evaluation and comparison of state-of-the-art indoor navigation solutions, and the research implications provide a summary of the critical observations, some insights, and directions for further developments. The paper maps VI needs in relation to research and development (R&D) trends using the evaluation criteria deemed most important by blind experts.

The Learning Healthcare System: Where are we now? A systematic review.

BACKGROUND AND OBJECTIVE: The Learning Healthcare System paradigm has attracted the attention of researchers worldwide. The great potential originating from high-scale health data reuse and the inclusion of patient perspectives into care models promises personalized care, lower costs of health services and minimized consumption of resources. The aim of this review is to summarize the attempts to adopt the novel paradigm, putting emphasis on implementations and evaluating the impact on current medical practices. METHOD: PRISMA methodology was followed for structuring the review process. Three major research databases (PubMed, IEEE Xplore and ACM DL) were queried with the predefined search terms "learning healthcare" and "learning health". Publications containing specific theoretical or empirical results were considered. RESULTS: Three hundred and fifty-eight publications were identified; however, only 32 met the inclusion criteria. Nineteen papers were characterized as theoretical contributions, while the rest presented empirical achievements. Only one paper described the initial estimates of impact and economy. DISCUSSION: Individualistic communication of studies ignoring popular frameworks for assessing and reporting research achievements prevents the systematic generation of knowledge. Evaluating the impact of the Learning Healthcare System instances where it is implemented could work as a catalyst in reaching higher acceptance and adoption of the proposed ideas by healthcare worldwide; however, it mostly remains described in theory. CONCLUSIONS: The review demonstrated the interest of researchers in exploring the Learning Healthcare System ideas. However, it also revealed minimal focus on evaluating the impact of the novel paradigm on both healthcare service delivery and patient outcome.

Assessing the impact of telestration on surgical telementoring: A randomized controlled trial.

INTRODUCTION: Using graphical annotations in surgical telementoring promises vast improvements in both clinical and educational outcomes. However, these assumptions do not consider the potential patient safety risks resulting from this feature. Major differences in regulations regarding the implementation of telestration encourage an assessment of the utility of this feature on the outcomes of telementoring sessions. METHODS: Eight students participated in a randomized controlled trial, comparing verbal with annotation-supplemented telementoring via video conferencing. A remote mentor guided the participants through four localization exercises, identifying the features in a still laparoscopic surgery scene using a laparoscopic simulator. Clinical and educational outcomes were assessed; the time consumption and quality of mentoring were determined. RESULTS: The study revealed no significant difference in localizing the intervention between the studied methods, while educational outcomes favoured verbal mentoring. Telestration-supplemented guidance was considerably faster and resulted in fewer miscommunications between the mentor and mentee. DISCUSSION: The initial hypothesis of the major clinical and education benefits of telestration in telementoring was not supported. A potential 33% decrease in the duration of the mentored episodes is expected due to the ability to annotate live video content. However, the impact of time saving on the outcome of the procedure remains unclear. Regardless of the quantitative measures, most of the participants and the mentor agreed that graphical annotations provide advantages over verbal guidance.

Video Conferencing Services in Healthcare: One Communication Platform to Support All.

We present a novel approach to the design of video conferencing (VC) systems, taking advantage of recent technological achievements in web-based implementation. Delivering VC functionality as a service over the Internet opens new grounds for easier integration, support, and application in many scenarios, since hardware-agnostic ad-hoc VC connections are a feature of the proposed architecture. Validity is demonstrated through latency measures in surgical telementoring service and comparing them to reported thresholds.

What device should be used for telementoring? Randomized controlled trial.

BACKGROUND AND OBJECTIVE: The paper analyzes behavioral patterns of mentors while using different mentoring devices to demonstrate the feasibility of multi-platform mentoring. The fundamental differences of devices supporting telementoring create threats for the perception and interpretation of the transmitted video, highlighting the necessity of exploring hardware usability aspects in a safety critical surgical mentoring scenario. MATERIALS AND METHODS: Three types of devices, based on the screen size, formed the arms for the randomized controlled trial. Streaming video recordings of a laparoscopic procedure to the mentors imitated the mentoring scenario. User preferences and response times were recorded while participating in a session performed on all devices. RESULTS: Median response to a mentoring request times were similar for mobile platforms; expected durations were considerably longer for stationary computer. Ability to perceive and identify anatomical structures was insignificantly lower on small sized devices. Stationary and tablet platforms were nearly equally preferred by the most of participants as default telementoring hardware. DISCUSSION: As a side effect, incompatibility of daily duties of the surgeons in the hospital and telementoring responsibilities while implementing systems locally was identified. Scaling up the use of the service in combination with the organizational changes of clinical staff looks like a promising solution. CONCLUSION: The trial demonstrated the feasibility of using all three types of devices for the purpose of mentoring, allowing users to choose the preferred platform. The paper provided initial results on the quality assurance of telementoring systems imposed by the regulatory documents.

An evaluation framework for defining the contributions of telestration in surgical telementoring.

BACKGROUND: An increasing quantity of research in the domain of telemedicine show a growing popularity and acceptance of care over distance systems among both clinicians and patients. We focus on telementoring solutions, developed for providing remote guidance to less experienced surgeons. Telestration is often regarded as an extra functionality of some telementoring systems. However, we advocate that telestration must be viewed as a core feature of telementoring due to its advantages. OBJECTIVE: To analyze and define concepts, parameters, and measurement procedures to evaluate the impact of using telestration while telementoring. METHODS: A systematic review of research dealing with telestration during remote guidance sessions was performed by querying three major online research databases (MEDLINE, Association of Computing Machinery, and Institute of Electrical and Electronics Engineers) using a predefined set of keywords ("laparoscopy", "annotate", "telestrate", "telestration", "annotation", "minimally invasive", and "MIS"). RESULTS: The keyword-based search identified 117 papers. Following the guidelines for performing a systematic review, only 8 publications were considered relevant for the final study. Moreover, a gap in research defining the impacts of telestration during telementoring was identified. To fill this niche, a framework for analyzing, reporting, and measuring the impacts of telestration was proposed. CONCLUSIONS: The presented framework lays the basics for the structured analysis and reporting of telestration applied to telementoring systems. It is the first step toward building an evidence knowledge base documenting the advantages of live video content annotation and supporting the presented connections between the concepts.

Surgical telementoring in knowledge translation--clinical outcomes and educational benefits: a comprehensive review.

BACKGROUND: Surgical telementoring has been reported for decades. However, there exists limited evidence of clinical outcome and educational benefits. OBJECTIVE: To perform a comprehensive review of surgical telementoring surveys published in the past 2 decades. RESULTS: Of 624 primary identified articles, 34 articles were reviewed. A total of 433 surgical procedures were performed by 180 surgeons. Most common telementored procedures were laparoscopic cholecystectomy (57 cases, 13%), endovascular treatment of aortic aneurysm (48 cases, 11%), laparoscopic colectomy (32 cases, 7%), and nefrectomies (41 cases, 9%). In all, 167 (38%) cases had a laparoscopic approach, and 8 cases (5%) were converted to open surgery. Overall, 20 complications (5%) were reported (liver bleeding, trocar port bleeding, bile collection, postoperative ileus, wound infection, serosa tears, iliac artery rupture, conversion open surgery). Eight surveys (23%) have structured assessment of educational outcomes. Telementoring was combined with simulators (n = 2) and robotics (n = 3). Twelve surveys (35%) were intercontinental. Technology satisfaction was high among 83% of surgeons. CONCLUSION: Few surveys have a structured assessment of educational outcome. Telementoring has improved impact on surgical education. Reported complication rate was 5%.